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ABSTRACT 

. . / *~ £ • A novel use of periodic functions, called the 

» periodic procedure, was recently introdtfced to make practical the use 
of certain physical measurement ideas in psychology*— Tills paper 
reports a successful attempt to apply the periodic procedure to an 
important psychological. measurement problem, the measurement of 
.aptitude test item difficulties. The difficulties of items on a 
* subtest of th.e Scholastic Aptitude Test were measured " with both the 
periodic procedure and with an item characteristic curve theory 
procedure. The principal finding was a close agreement between the v 
/two methods. This close agreement was particularly striking because 
/ different samples (from the same test administration)' were used by 
the two methods* The statistical development of the periodic 
procedure is presented along with an example of its use* 
(Author/JKS) „ 0 * 
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The Use of Periodic Functions to Measure the Difficulty of Aptitude Test Items 



ABSTRACT 



\ 



Two different procedures were used to measure thk difficulties of some 
Scholastic" Aptitude Test items: a new distribution-free procedure that 
uses periodic functions and LOGIST, a well-developed optimization 
procedure that fits a logistic model. Despite the fact that the tvo 
procedures used different data in very different ways, they obtained 
virtually the same numbers. 



ERIC 



3 



The Use of Periodic Functions to Measure the Difficulty of Aptitude Test Items* 

• INTRODUCTION 

; \ 

A novel use of periodic functions, called the "periodic procedure, 1 ' 
i was recently introduced (Levine, 1975) to make practical the use of 
pertain physical measurement ideas in psychology. This paper reports a ' . 
successful attempt to apply the periodic procedure to an important 
psychological measurement problem, the measurement of aptitude est item 
difficulties- . _ 

The difficulties of items on ,a subtest of the College Board's 
Scholastic Aptitude Test were measured with both, the periodic procedure 
and with LOGIST, a well-developed alternativp prnngflm^. — Oui^riirclpal 



finding was a close agreement between the two methods. This close 
agreement is particularly striking because 'different samples (from the 
same test administration) rtere used by the two methods. 

The agreement provides \support in favor of both methods. On the one 
hand, since the periodic procedure is distribution free, the close agree- 
ment shows that the stronger assumptions underlying LOGIST are not a source 
of error in connection with its application to the SAT (see also Lord, 
1970 ). On the other hand, the close agreement indicates that our weak 
assumptions are strong enough to determine the SAT item difficulties, 



*We gratefully acknowledge the editorial advice and criticism of 
Joseph Kruskal/ Ingram Olkin and Thomas Sttfoud- The long exposition of 
the periodic procedure in Section II was written in response to Kruskal* s 
detailed comments on Levine (1975)* This project would not have been 
attempted had it not been for Frederic M. Lord's earlier findings, 
especially lord (1970).. 
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and that our novel method is reasonably; safe against the unanticipated 
difficulties that often beset new methods.: , 

The periodic procedure exemplifies a new approach to measurement, 
characterized by a use of general functional equations and group theoretical 
methods in place of specific distribution assumptions (Levine, 1970, 
1972, i£75, 1976). A great deal of work remains to be, done before the 
new methods can be regarded as fully comparable to' the better-developed, 
widely used "optimizations methods," i.e., to the methods which, like » 
IOGIST, work by ^t^nnj^^ of fit for a model 

making a specific distribution assumption. However, the close agreement 
suggests that the new methods can be as accurate as the optimization methods. 
Furthermore, at least in some applications, functional equations 
based methods may eventually be preferred to optimization methods 
because (l) they do not require simultaneous estimation of ability 
parameters, which may have large sampling errors, (2) they are not 
iterative or otherwise susceptible to convergence problems, and (3) they 
rest^ on general psychometric assumptions and in particular are distribution 
free. 



I. OVERVIEW 

j . ■ 

The goal of this research is to evaluate the periodic procedure by 
attempting to estimate item difficulties for a subtest of the Scholastic 

^Aptitude Test. The periodic procedure is Reviewed in Section II. Some 
necessary psychometric theory and results are presented in Sections III 
and IV. Our results are given in Sectj£^J^JEhe-courp\iter programs are 

_discus sed~itf~SecHon' VI. 



II. THE PERIODIC PROCEDURE 

' ' '* - 

In this section some basic definitions are stated and the periodic 
procedure is described in a form convenient for the application. Por_^___ 
more general discussion of the periodic^procedur^, "^discussion of f %he 

relationship tcTlength measurement and a worked example, see' Levine (1975)* 

\ 

II. 1 Definitions 

The basic operation of the periodic procedure is function composition * 
Tf f and g are functions and if for all x such that -g(x) v is 

0 

defined f[g(x)] is also defined, "then the composition of and g 
is defined to be the function written fg and given by the f6rmular\ 

fg(x) = f(g(x)] . 

If f is a real function with domain of definition D , the graph 
of f is the subset of the plane 

6^(f) = { < x ,y > e IR : x c D and y = f(x)} :. 

For our purposes, the most important fact about graphs is that the graph 
of the composition of two functions can be determined from the graphs 
of the composed functions. Thus 

Vv^(fg) = { < x,y > : for some z , < x,z > e ^(g)& < z,y > 

c 6p)) . 

If the compositions wu and uw are both defined and %£ for all 
values of x in the domain of definition of u and y in the domain of 



w , we have both wu(x)^j^and--uw(^X^ t jy l ^ then' w will be called the" 
Inverse^ of u and written u" 1 . When inverses and composites are defined 
as above, elementary arguments can be used to show * 

(i) a function has an inverse if and only if it 'is 1 - 1 . 
(ii) . the inverse of a function is unique, 
(iii) if u is a 1 - 1 function with inverse w , then w 

•is a 1 - 1 function with inverse .u.» # "i . 

(iv) if u is a 1 - 1 function with domain D , the graph of the 

> < 

inverse of u is { < u(x),x > : x is in D} • 
lie last point is especially useful* In the psychometric application, 
we work with piecewise-linear tabled functions. The last point implies - 
* that; we obtain the graph of the inverse of a function simply by' inter- 
changing x and y tables. 

A translation is a. real function of the form /(x) = x + k • A 
function f is called a conjugate of a translation if there is a trans- 
lation and a continuous increasing 1-1 function u such that 
f = u ^(\x , i.e., if for some constant k and continuous, strictly 
increasing function u , £(•,) = u"^"[u(*) + k] . 

By repeatedly composing a function with itself, one defines the 

iterates of the function. Thus f = ff is the second iterate, £ = ff 

k 3 

is the second, f = ff the fourth, etc.- If f is conjugate to- a 

translation, then all of its iterates are defined, and from the conjugacy 

equation f(-) = u 1 [u(-) • k] one obtains the equation 
n —1 

f (•) = u [u(-) » nk] for each iterate.' If the usual conventions 
f°(x) = x , f 1 = f and f n = (f 1 ) 11 are used, then this equation is . 
valid for all integers n . 
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The periodic procedure is applica^ie to pairs of functions 
simultaneously conjugate to translations. A pair of functions' f,g are 
simultaneously conjugate to translations if a function u can be found 
that simultaneously satisfies both conjugacy equations, i.e., if for a' 
single increasing 1-1 function u and a pair of constants kp,k 

; I g 

f(0 = u _1 [u(.) + kJ , 



(II.1) 



S(0 = u _1 [u(.) + kJ 



Note that simultaneously conjugate functions commute , i.e., if 

f,g satisfy (II. l) then fg(x) = u _1 [u(x) + k " + k ] = gf(x) and 

I g 

(II.2) fg = gf . 



II«2 Computing Ratios from Graphs 

The periodic procedure is a means for computing the ratio B = k /k 

f g 

for a pair of simultaneous conjugates satisfying (II. l). It can be used 
when the graphs of the conjugates are given but when all that is known 

aJ)out u is that it is a strictly increasing, continuous real function. 

\ 

To reintroduce the logic of the periodic procedure consider & pair 
of conjugates o f,g satisfying (II. l). For simplicity, we assume k f 

o 

and k are both positive/ Since k . = -k^ , this results in no loss 

^ 1 /> 

> of "generality. 

In the next fev; paragraphs it will be shown how kjk could be 

r g 

computed by using only the graphs of f and g . 
Suppose for some x , we have c 
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From (DM) and the feet that u is an increasing 1-1 function, it, 
follows that f(x) < g(x) is equivalent to k r < k . Consequently, if 
f (x) < g(k) for any x , k^ < k and f(y) < g(y) for all- y . Thus 
a superficial inspection of the graphs of f and g tells whether 
£ 5 1 *• 

To get a more precise estimate of B, consider the iterates f n 

and g m . Since f n (x) equals f [f^x)] and g m = gg*" 1 , points 

on the graphs of iterates of f and £ can be computed recursively 

from She graphs of f and g , without referring^ to the function 

u or the, constants k« and k of the conjugacy equations. Thus the 

8 

graphs of f and g contain all the information needed to decide whether 
or not any inequality of the form 

(II.5) f n (x) < g%) 

f 

is true. But since f n (») = u" 1 [u(») + nk ] and g m (0 = u" 1 [u(0 mk ] 

are also simultaneously conjugate to translations, (ll«5) is equivalent 

to nk- < mk . 
f - g 

Thus, by referring only to the graphs of f and g for each 
integer n we can find the smallest integer m = m n satisfying (II. 3). 
Thus for m = m n we have the inequalities 

f%0 < g"(x) , 
g n " L (x) < r n (x) . 
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These inequalities are^ equivalent to 



or 



(m - l)k < nk. < mk 
g f • - g 



(ilJlr 0<xajn - k^/k g < l/n 
i > 



Consequently, we can, in principle, use the graphs of f and g to decide 
whether inequalities c form f^x) < g m (x) are valid for large value^ 
of n 0 and ra aricl thereby approximate B with any desired accuracy. In 
'this sense, the graphs of f,g contain all the information needed to 
compute the ratio. ^ 

II .3 Computing Ratios from Segments of Graphs <> . * 

Comparing iterates or, more generally, products in an ordered semi- " 
group, plays a fundamental role in the logic of physical measurement 
(Levine, 1975) • But applications to psychological data have been blocked 
by various difficulties. The most serious difficulty^ is the fact that 
the graphs of f and g are only known over a finite interval of the 
x axis, often a fairly narrow one. Consequently the higher iterates 
cannot.be obtained, since the calculation of f^x) requires that, we 
evaluate " f at x , at x.. = f(x) , at x 0 = f (x ) , etc., alid we 
rabidly leave the domain where f is defined. Stated in another way, 
the domain of definition of f n rapidly gets smaller as n increases, 
and soon vanishes entirely. We have only rarely found empirical graphs 
of conjugates that could be used to directly test an inequality of the 
form f n (x) < g m ( x ) f° r n or m greater than 5» 



A related difficulty is that the graphs are not known exactly, 
but only approximated by finite tables of numbers having limited precision 
Each composition reduces the precision, and again the comparison of higher 
iterates is difficult. 

The periodic procedure uses an elementary functional equation and 
the properties of periodic functions to provide an indirect way for 
testing inequalities. In so doing it avoids the problem with higber 
iterates. At the same time it leads to natural ways to combine observa- 
tions and overcome the difficulties with finite approximations* It also 
suggests ways to judge the^degree to which data satisfies a model 
implying the conjugacy equations. 

The periodic procedure begin£ with*Abel f s functional equation 

(11. 5) g(-) = w'Vo) + 1] 

where g is a given function and w is to be determined. Fortunately, 

it, is easy to solve this equation for w . We begin the periodic 

procedure by computing a continuous, strictly "increasing function w 

-1 

that satisfies g(x) = w [w(x) f 1] for all values of x in the 
domain of g . (References and a discussion of this computation are 
^given in Section VI. i.) 

This function is used to compute a function j>s defined by • 

(11. 6) jrf(x) = wfw~ X (x) . 

Since f - = (wfwTV = vfV 1 and g m (x) = w~ X [w(x) -» m] , it follows 
that (II. 3) f°(x) < g m (x) is equivalent to 



(];i*7) Ax) <»x + m . " * . 

Thus if the higher iterates of <f> could be computed, k^/k could be 
computed • 

By using periodic functions,* all the iterates^of / can be' computed, 
even wfr^n the higher iterates o.f f and g cannot. 

The condition (II. 2) fg =• gf leads to periodic functions as follows J 
Let; -jf be the translation p(x) = x + 1 . Theri g = w pw , and - 
fg = gf can be written f(w" 1 pw) = (w~ 1( pw)f v Equivalently, 
wff(w~ pw)]w r = w[f(w pw)]w that is, 0 

c5p = (wfw^Jp = pCwfw" 1 ) = p^ 

and . s * . . \ • • 

a - /(x + i) = ^(x) + r 

Thus if Q(x) = /(x) - x , then 

«• «> 

e(x + l) = jf(x + l) - (x +i) 

= /(x) + 1 - (x + 1) 
' = '/(*) " x , *" 
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. * * and 0 is periodic with period equal to one. Consequently, if 9 is 
t\ defined on an interval of length equal to or greater than one, then 9(x) 
can be regarded as known for all x . But in thiS case, ^(x) is also 
known for all x . For j^(x) is simply 9(x) + x . Consequently 

j^ n (x) » <f>[(f n 1 (x)] can Ire computed Recursively for all n> and k^/k 

x f . g 

< 

can be computed with any desired accuracy. 

I n a11 the applications we know, about, only points on short segments 
of graphs can be adequately estimated from data. (A segment *of a graph 
of a function is ; simply the^ graph of the restriction of the function to 
v^-ftgsu ^ n in * erval# ) is not possible to compute graphs of higher iterates 
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of f and g from segments. However a' segment of the graph of g 

, -* 
permits the t computation of a segment of graph of w ; and with a segment 

? * 
of the graph of - w and of f we can 'compute a segment of the graph of 

' ! 

j> and 9 . But from a Jong enough" segment of the' graph 9 we can compute 
all of the graph of 9 and <f> . This jpermits us to check ; ^ n (x) < x + m 
and (IIO) for all n,m . Thus we can 'compute B with any desired 
-accuracy from segments too short to define higher iterates of f and 

g • 

This completes, the review of the periodic procedure. 

In the next two sections we prepare to apply the periodic procedure 
by showing that current psychometric theory implies that certain empirical 
curves are close to the graphs of simultaneous conjugates. The empirical 
curves permit us to compute a segment of the graph of a function such that 
if the psychometric theory v were correct in every detail *and if our data 

14 



were based on enough observations, the graph of the empirical function , 
would be indistinguishable from the graph of a periodic function.. We 
will la ter use this fact to obtain a rough index' of tfte appropriateness 
of the periodic procedure and a method for combining observations to 
increase measurement accuracy. In the results sectiop we will re$&& 
our application of the periodic procedure* to psychometric data. It will 
be showyi that the periodic procedure "works" in the .sense that it agrees 
with a thoroughly tested >alternative measurement procedure. 



III. SOME BASIC PSYCHOME'JRICS 

According to item characteristic curve theory and the logistic 
model, Lord's LOGIST parameter estimates and periodic procedure estimates 
should agree. In this section basic item characteristic curve theory, 
the logistic model and the logic of the! LOGIST programs are reviewed* A 
generalization of the logistic model is then* introduced^ and some empiri- 
cal results supporting, the logistic model and LOGIST are cited. 

•Si'* * , *. 

III«1 Item -Characteristic ; £urve Theory and the LOGIST Programs 

Item characteristic curve theory provides stochastic models for 

%L - / 

aptitude tests'. The theory .is designed f or test s with many separate 

multiple choic'e items. Each candidate or test taker is assumed to have 

some (unknown) ability. His answers on each item are scored zero for 

wrong and one for right. The ^theory relates item scores to N ability. 

According to- the theory the conditional probability of* a randomly 

chosen candidate with ability ©.^correctly answering the i -th item 

of a test is an increasing function of 0 , , called the item 

■characteristic curve.* The candidate' s* right and wrong answers ax;e 

regarded as the outcome of a two-stage experiment.* First an individual 

with some (unobserved) ability 0 is sampled. . Then a sequence of 

independent dichotomous random variables corresponding to the items, is 

observed. The probability, that 'the i -th.j.tem is scored correct is 



-11+-, 

Let < e ^ e 2^ e 5 ••• e n > be a vec<fco ^ zeros and ones. The 
conditional probability 1 that a randomly selected candidate has this 
particular pattern of correct and incorrect answers is 



n . e.' , l-e.' 
* (III.1) H P.(0) x [i - p.(o)] 1 . 

' , " i=l x » * 1 



We will later need to assume that the distribution of ability in -the 
population ot examinees has a continuous density. . If the ability density 
is denoted by f then the unconditional probability , of observing the 
pattern of correct and incorrect answers is 



/n e. l-e. 

tfrh Jl P.(e):^[r- b.(g)] 1 
. -i=i 1 x . 



dO' 



and the joint probability q;C sampling an examinee with ability 0 in an 
interval T and the given pattern or answers is 



f 



/n e. l-e. 

f(e) it p.(g) x [i - p.(g)] • 1 d e 

T ' i=l 1 1 



The goal of testing is to estimate the individual examinee's ability 
from ~his' pattern of right and wrong answers. If the item characteristic 
curves P are specified, this is fairly routine. In this paper we are 
primarily concerned with using data to specify i\,em characteristic curves. 

The LOGIST programs compute maximum likelihood > estimates of the 
item characteristic curves. Each 1?^ is assumed to have the form 
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P^tjT- c. + (1 - c.)L[a.(t - b i )] 



where L is the logistic function, L(t) = l/[l + e -t ] , and a.^ , b. , 
^ — are-reai parameters controlling the shape of P^^ . (The role of thes 
parameters and the logistic function is discussed in the next section.) 
Ordinarily a set {a} of at least a thousand examinees is processed by 
IOGIST. The. typical candidate a produces a vector of item scores which 
has conditional probability , j 



i=l 1 a 18 



UDGIST forms the product* 



■i 

1 



(in.Jt), n n p. (9 ) 6ia Q.(9 J 1 6ia 

\ . a i=l 1 a 1 c 



A * 

and iteratively seeks a vector of abilities 9 q and item parameters 

A A A * 

" 8 i 9 ^i ' c i ^xiroizing- (ill* 1 *)* 

; The IOGIST programs have many options and are regularly revised. 
The data and LOGIST application used for refererics; in this paper have 
been describe^ by Lord (1968). We will review special features of -that 
study as needed. " . % 



III #2 The Form of Item Characteristic Curves- - 

-Various item characteristic curve tjiodels differ in their assuit^iatTs' 
about the' shape and functional form of the P. 's. - There is considerable 



evidence to support the logistic and normal models'*" In this section we 

- . ■ / 
review these models and introduce a generalization called the linear 

model. 



The logistic model assumes that each Pj has functional form 

(III.5) P.(6) = c. + (1 - c.)L[a.(9 - ^J] 

where L is the S -shaped logistic "function. A plot of the graph of s * 
P^ appears S -shaped with a left asymptote of c^ and a right 
asymptote of 1. P^ is 1 - 1, strictly increasing, continuous and has ^ 
a single point of inflection. - ' 

The parameters a. , b. , c. describe three more, or less v 1 

1 7 1 1 ( ,v , 

independent properties of items. An increase in tire "difficulty 11 - parameter 
b. shifts the gr'aph of P. along the x -axis and decreases the 
probability of a correct answer. a# all levels. Variation of the posi- 

tive "discrimination" parameter most conspicuously affects the steepness T 

' ■% 

, of at its point of inflection. Geometrically it stretches or con- 

tracts the graph. The "guessing" parameter controls the height of 

the left asymptote of • This parameter is sometimes interpreted as 

* / 

the limiting probability of an examinee with no preparation or ability 
correctly guessing the answer to the item. 

A familiar model commonly associated with Rasch (i960) postulates 

V 

o 

' : Pj/e) = e/(o b.) 

where ability is assumed to be positive. Birnbaum (I9b8> page 1*02) 
has pointed out that this model can be regarded as a special case of 



the logistic model since / 

9/(0 + b ) = c (1 - c.)L[a (0* - b*)] , 

± ± ± 1 o X 

where "c = 0 , a = 1 , 0* = log O , b* = log b. £ - We will use this 

^ , ix» 

i 

model only to motivate some of the definitions of the next section. 

/ 

Unfortunately, it is not sufficiently general to describe the data we 
wish to study. ; 

By replacing the logistic function L(x) by the normal integral 



• W - ~r f 

V2* J 



X ^ 
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one obtains the normal model... Since |<i>(x) - L(loc)l where D is a 
known constant is very small for all values of x , there ±% m Very little 
difference between the shapes of ice's for the normal and logistic model. 

In this paper we assume that tests satisfy a generalization of the 
logistic and normal models called the linear model. A„.set of continuous, 
strictly increasing icc ! s {$/\ satisfy a linear model *if there exists 
a > continuous, strictly increasing probabiiit^distribution P and 
real" constants {a.) , {b . ) , {c.) such that for all 0 

\i9) = c. + (1 - c.)P[a.(0 - b.)] . 

(Sudh ice's are said to satisfy a "linear 11 model because any two curves 
can be equated by a linear or affine transformation of the plane having 
form < x,y > ->< ax + b, cy + 1 - c > ) 
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For concreteness, P may be thought of as either the logistic or 

> 

normal* But the analysis presented in this paper is equally applicable 

k i * 

to the logistic, normal or other continuous, strictly increasing 
distribation function. 

The fact that the periodic procedure does not require complete 
specification the functional form of the. has important practical 

implications. It is closely related to the {^variance of Section 

«- 

which greatly simplifies data analysis. 

-Our goal is. to evaluate the periodic procedure by using\t" to . * 
estimate item parameters from some frequently analyzed data, evidently x , 
well described by item characteristic theory. Lord (1970) has already 
obtained impressive evidence for the adequacy df Ipgistic model. The 
close agreement between par^neter estimates (obtained without the . 
logistic assumption) and IDGIST parameter estimates provides further 
support- for the logistic toodel. 



ERIC 



6 1 



^9 



IV. ITEM-ITEM CURVES 

* The following subsections are used to introduce and discuss the 
basic properties of the item-item ability curve, a generally handy 
adjunct to item characteristic curve theory and an essential tool for 
the application of peripdic functions. To motivate this new development, 
recall tha> a continuous 1 — 1 transformation of ability was shown to 
change the item characteristic curves of the Rasch model' into the curves 
of a one-parameter logistic model. Item-item curves will be seen to . 
carry very much the same information as ice's. But we will show 
(Section IV •2) that they are invariant vmder all 1-1 continuous * - 

transformations of ability. By using this invariance we are able to 
.specify consistent estimators of points on the item-item ability curves 
(Section IV.3)» Item-item ability curves can be related to conjugates of 
translations in various ways. We outline the way actually used (Section 
IV. *0 in this study along with alternative ways, which may be preferred 
for free-response data and other psychometric data for which the periodic 
procedure may be applied'. 



IV. 1 Item- Item Curves and- Graphs 
) 

By considering pairs of items, one defines item-item ability curves I 
The (ij) -th item-item ability curve is the subset of the unit square. 

- [ < x,y > : for some ability 0 , x = P.(0) and > = P.(©)} 



Every item characteristic curve considered In this paper is 1 - 1 
i:nd thus Jias an inverse. "Thus for each P^^ and every t in the range 
of P i we may write t = P i [P^ 1 (t)] . Consequently, each item-item 
ability curve can be written in the form 

{ < t,Pj[P^ 1 (t)] > : for some ability Q , t = P^O)') 

In other words, (ij) -th item-item ability curve is simply the graph of 
the function P.P."** • 

IV. 2 Item-It em Curves and Transformations of Ability 

Since ability 9 is not observed, one is led* to consider various ob- 
served indices of ability such as proportion of correct items, formula 
scores, grade point average, composite scores on a battery of tests not 
containing the items beirig studied, maximum likelihood estimate of ability 
etc. If % is such an index, the h (i,j) -th item-item index curve of 
a test is the curve 

{ < x,y > : for some value of £ , x is the conditional 
probability of correctly answeringHhe i -th 
item and y , correctly fnswering the j -th} 

There is a special case, which is important for theoretical develop- 
ments and which is conceptually important for our application. Suppose 
an index £ is a 1 - 1 function of ability Q , i.e., that for some 
invertible function v we have = v(Q) . In this case the item-item 



index curves and item-item ability curves are equal. This is true because 
for each value g the conditional probability 



Probfitem i is correct I index 6 = 6) 

o 

equals . 

. ° Probfitem i is correct lability 9 equals v" 1 (g Q )} 

which. equals Prjv "'"(l )] • Thus the item-item index curve is the graph 

-1 -1 -1 * 

of the function (P.v )(P.v ) which is clearly equal to the graph 
of the function P.P7 1 . It follows that the (ij) -th item-item index 
curve equals the (ij) -th item-item ability curve. 

This argument shows that the same "item-item curves are obtained 
with any 1,-1 transformation of ability. In particular, strictly 
increasing, continuous transformations of ability ^ leave item-item 
ability curves invariant. 

This simple invariance turns out to be very important. It greatly 
simplifies the estimation of item-item curves. It makes possible 
results (presented in the next section) that are used to relate observed 
item-item proportion correct curves and item-item ability curves. It 
also implies, incidentally, that two models such as the Rascti and one- 
( parameter logistic with different item characteristic curves can have 
exactly the same item-item curves.' 



IV*3 Relating Item-Item Curves to Observations 

The purpose of this section is to describe some asymptotic results 
that are used to estimate points on item-item ability curves • 

Consider Repeatedly sampling examinees from a population in which 
ability has a normal or some similar smooth probability density function 
f . Each r "lpled examinee takes the same long test. As noted in 
Section III.l both ability 0 and the item scores u^ can be regarded 
as random variables.' The cited asymptotic results follow from regularity 
conditions and from formula (III. 3), the forrula for the joint distribution 
of ability and the first n scores. * 

We intend to comment on the suitability of the observed proportion 
of correct answers as an index of ability V Thus we must define the pro- 
portion correct random variable z 

n 

i n , 
z = ± Z u. 
n n i=l 1 

i.e#, the random variable giving the average item score or the proportion 

of correct answers on the first n items • 

Let £ be a fixed proportion in the range of each P^^ . Consider 

the average \i of the first n item characteristic curves 
n 



u (t) = i Z P.(t) . 



n i=l 1 



.Since according to the linear model each P. is strictly increasing and 

continuous, the average \i must £e also. Thus \x is 1 - 1 and has a 
5 n n 
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^ . ■ 

strictly increasing, continuous inverse | . Since £ is in the range 

of\each ? i , £ is the range of ^ and S n (£) is defined,, 

^As we consider longer and longer initial segments of the sequence 

of te6t items, the sequence of numbers U n (£)J roay or may not converge . 

Howevek it still can be shown that under quite general conditions it 

is possible to specify a sequence of "proportion interval widths" 

\ x 
s n ^hat sl6wly decrease to zero such that for each item i the 



difference 



e{u. 
1 



r 

tends to zero as n increases. 

In other words, asymptotically, the expected item score for item 
i — given that proportion ^correct on the first n items is close to 
{ —is approximately equal to the i -th item characteristic curve 
composed with a strictly increasing continuous transformation relating 
the set. of possible proportions to the ability continuum. Furthermore, 
the transformation g is independent of i . 

To apply this fact, one considers a finite set of proportions 

and a pair of items, say for definiteness items one and two. A very 
large sample A of independently sampled examinees is selected and 
administered an n item tesfe. For each candidate a e A , 'pro- 
portion correct z n (*) is computed and used as an index to define 
R subsamples 



2b 



. . A r = {a e A: U n (a) - 5 r l < s n ) , r = l,2,...,R. . 

As the size N(A r ) of these subaamples becomes large, each observed 
proportion 



N{a € A I a answers item i correctly) 

r " A ^ 

p ir = ~ ; ? N(A ) ; 



will, with high probability, be close to its expected value 



' e(u; 



U - 5 I < s ) , 

n 3 r — n' 7 



and therefore close to P.[£ ((; )] . Thus the points in the pWe 

i n r ( 

<P X r »P 2 r > are likely to Be close to the'points < P,t (£ -),-? 2 l **} > 
on* the item-item ability> curve < P-^I^ > >' This fol l° vs from the 

fact that each £ is 1 - 1 % and the invariance described in the 
n 

preceding., section . 

Proofs of 'these results and a discussion of rates of convergence 
will be discussed in a separate paper currently being prepared. 

In this study empirical item-item proportion correct curVfes have 
been used as* 'estimates of points on item-item ability curves. 

IV A, Relating Item-Item Curves to Conjugates 

Before the periodic procedure can be" applied, estimates of points 
on conjugates of translations must be obtained. We have just shown that 
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~ ~etnpi-r ieai iteril-item proportion correct curves are estimates of points 
on ^theoretical item- item ability curves. In- this section it %s shown 
tliat the theoretical iia curves can be related to conjugates in various 
ways. Each way suggests a somewhat different data analysis procedure. 
The special purpose of this study and the special nature of our data 

* N « - V 

have selected a particular way, presented below. Alternative ways are 
noted in passing. 

■ ■■ ■ ■ ■■ \ 

-To^begin, consider a one parameter model version of the linear model 

in which c. = 0 and a. = 1 . so that every, ice has form 
i i * ' * 

- P^e) = p(o - b.) . • A 

V 

The (i, j) -th item-item ability curve is ^simply the graph of the 
'conjugate 

' -1 * ' ' * ' 

where /. . is the translation © ->© +b. - b. . 
In the general linear model each ice has form 

P.(0) = c. + (1 - c.)P/.(0) 

where c^ is the "guessing parameter, 11 and is the linear transformation 

0 ->a.(0 - b.) = /.(0) . 

tf - « 

* . 

The item-item ability curves here are the graphs of functions of form 
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where each function C ± ' is defined by (^(t) = c + (l - c^t . This 
function can be rewritten as (C MLC 1 )(C.?)~ 1 where /77 1 can . 
easily be shown to.be 

a . , 
© 9 + a.(b. - b'.) * . 

Thus if item i is compared with an item j with the same discrimination 
parameter, a. /a. = 1 and (i,j) -th item-item ability curve is the 
graph of a function very much like the graph of a conjugate, 

• c.pa./- 1 )^)- 1 . - . 

If c i " is assumed to be ^ reciprocal of the number of multiple choice 
alternatives and both items have the same number of -alternatives then 
C. ■= . C. and 

0 i' . 

is again a conjugate of a translation. 

When the ^ 1 s are set equal to the reciprocal of the number of choices 

whicfi can otherwise be regarded as known, a simple linear transformation 

of the plane can be specified and used to remove the effects of the c ! s. 

i . 

Using elementary algebra, one can verify that the transformation 
< x,y > -»< (x - c.)/(l - c.), (y - Cj )/(l - c.) > 

c 

carries the (ij) -th item-item ability curve onto the graph of the 
function PC/XV"^. 



j In this study it is appropriate to regard both, the, a. f s and c.'s 
;as known* (A discussion of this, point follows in the next section.) 
Consequently we, were a>le to pair items with equal discrimination and 
rescale empirical item-item proportion correct curves to obtain estimates 
of points on 'the graphs of , conjugates of translations. K 

IV. 5 Concluding Comments on Our Method of Using Item-Item Curves 

In this section we wish to state the rationale for our way of estimating 
points on the graph of cprijugates. ; * 

The preceding sections show what would happen in a large scale 
simulation of item characteristic curve theory with, say,, one parameter 
logistic ice's, a bounded sequence of item difficulties and a normal ^ r * 
distribution of abilities: If a pair of conjugates were approximated 
from empirical item-item proportion correct corves, smoothed and used 
as input for the periodic procedure, then as t£st length and examinee 

V 

sample size increased, the y periodic procedure would almost surely give 
essentially perfect estimates of item difficulties. Some nontrivial 
mathematical questions would have to be worked out to properly qualify * 

■* 

and prove this assertion in detail.' But we do not develop this line 

of reasoning any further here because it is tangential to the previously 

stated goals of this, study. j >. [ m 

The central question for this research is not mathematical; it can 
only be answered by data. It is: Can the periodic procedure' be useful 
wit i current tests, which are only imperfectly described by item J 
characteristic curve theory? 

To make our point clear, recall that item characteristic curve theory 
is an idealization; .i.e., an abstract, incomplete .description of aptitude 
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test- data. It lacks, for example, an explicit account of the complex 
interdependences between items referring to the same reading passage on 
the typical verbal aptitude test. 

However, ice has proven to be a powerful tool for investigating 
important problems. Lord (1975) cites 17 recently published applications. 
Ice's role in studies in progress as well as the absence of a likely 
alternative makes itrfairly certain that ice will be even, more- widely 
used in the next decade. 

We wish to consider the type of data that is going J$o continue " 

V 

to be analyzed with ice. By reanalyzing such data with the periodic 
procedure we intend to decide whether the periodic procedure estimates 
of item difficulty agree sufficiently well, with standard procedures to 
justify further development. 

The reference estimation procedure, Lord's LOGIST program, 
simultaneously fit a^^ r s, b i 's, and 's (as well as 0 's) for 
samples of examinees to the logistic model. In its present form, 'the 
periodic procedure estimates only .b^ r s. Since our goal is to compare 
periodic procedure estimates with LOGIST b^^ 's and not to document a new 
estimation scheme, it is legitimate and desirable to use LOGIST. estimates 
of & r s and c; 's. t Thus we are led to'tfieflbllbwing steps in 
estimating points on graphs of conjugates: 
" 1. pair items with equal LOGIST a. ! s. ; 

2. compute empirical i*tem-£tem proportion correct curves for 
these item pairs. 

3. use K)GIST c^ ! s to rescale and obtain estimates of points 
on the graphs* of conjugates of translations. 
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All of the essential details of the implementation / bf these steps., 
are presented in subsequent sections ♦ 



A 
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... V V. DATA AMD RESULTS' 

Our major finding is close in agreement between LOGIST and periodic 

estimates. In 5 this section we summarize the basic facts about the 

y 

data and computations; additional details are in the references and the 

r 

sections oh computation. 

Lord (1968) applied LOGIST to a sample of 2^862 SAT-V candidates. 

/* • '• ■' n. 

Number right scores on the SAT-M were used to obtain a sample with a 

relatively large proportion of low ability candidates. The cV 

. - ±x 

x 

guessing parameters vere-estimated to be equal tojfche observed pro- 
portions correct for low scoring candidates. Omitted and not reached 
items were scored as if they had been answered incorrectly. The a f s, 
b 1 s, and 0 ! s were estimated by minimizing equation Ill.k. • 

In the following x and x are used to denote LOGIST and periodic 
estimates of a parameter x . 

ICGIST estimates, provided by Lord, were ijsed to select a subtest 
from the SAT-V. Means, standard deviations and other summary statistics 
are given in Table 1... The LOGIST estimated parameters of the seven 
item subtest. are given in Table 2. These are all the. items with 
(IOGIST estimated a. ) equal to 1.22 + .02. This particular constant 
was chosen because, .taany items Jfiappened j to have a_^ f s close to 1.22. 

Item-item proportion correct curves were estimated by first computing' 1 

item test regressions from the entire administration of 103,275 candidates. 

• ** ■ " , < < - fc 

The item test regression for item ^ i is ' essentially the vector proportions 

C P ir ) of Section III. 3 where r is the index of the proportion £ . 



Table 1 



Summary Statistics for'-IiOGIST Estimated Barameters 



7 



Mean / 

Standard Deviation 
Median 
Maximum 
Minimum - 





• b i 


A, 

c. 




i 




r 




1.09 


.65 • 


•15 




•385 


.855 


.05 




X.OT 


•77 


.16 


• 

f 


2.03 


. 2.1*25 


.2 




.1»0 


-1.52 


'.ok ■ 


6. 

• * c 



V '* 
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. Table 2 
LOGIST Estimates for Subtest 



item"; .number 


/\ 
a . 
i 


b. . 
1 


c 


51 • 


1.2058 


-5»ioii ' 


.20 


6 


1.2072 


.7198 


.12 


77 


1.2155 


.7026 




. 20 


1.2170 • 


1.6270 , 


.09 


So 


1.2180 


1.0919:- 


.15 


Hi 


. 1.2521 


.5056 . 


.20 


59 


1.231a 


-.61)78 


.20 



3o 



More explicitly, 



p. = N /M. 
*ir ir 1 



ir 



0 



where 



<N. : = the number of candidates answering item i correctly 
ir ■ » 

and either. 2r or 2r - 1 other items correctly; 




M. = N. + the number, of candidates answering item i 
ir ir & 

incorrectly and either 2r or 2r^ - 1 other items 



correctly. 



This minor departure from 111*3 avoids the spurious dependencies discussed 
in Lord and Novick (1968> Section 16.4.1) by conditioning on the number 
correct on the whole test, except for item i , rather than on the whole 
test. 

The plot of the item test regression (i.e., the plot of p ir as a 
function of f ) generally appears to be a set of closely spaced points 
on the graph of a smooth, monotonic function. .This is especially true 
for intermediate values of £ for which the observed proportions are 
based on a large number of examinees. Some nonmonotonic ities were 
observed for very low and very high proportions* correct. This "is 'to 
be expected since there were few examinees with very high or very low 
proportion correct scores, (in Section IV. 2 we report °a technique for 
preventing these unstable proportions from affecting our item difficulty 
estimates. ) 



As 'a first step towards obtaining curves suitable for the periodic 
procedure, for each item' i a vector ( p* ) was computed. The first 



lr 



entry p^ is tHe asymptote c^^ used -by LOGIST. The last eptry p; 



iR 



is one. The other values are computed by initially setting p* r = 

and then applying the algorithm described by Kruskal (19&, Section 8) 

to compute the monotonic array of points beginning with and ending 

with one maximizing a quadratic index of goodness of fit. Ties introduced 

by the algorithm were broken by making vety small adjustments of the equal 

m Pt ! s. x Jn this way each item was used to generate a vector of strictly 

increasing numbers ( p* ) approximately equal to the observed 

proportions ( P^ r )• ' v 

The i -th and j -th vectors were then used to specify estimates 

{ < p£ r >Pj r > J of points on the ij -th item-item proportion* correct 

curve. The c. f s were then used as described in Section VJ.k to 
i 

estimate points on conjugates. 

In this way the ij -th pair of " subtest items was used to specify 

an array of points .{ < x.(r),y.(r) > } in the plane. Since both 

<\ 

x.(r) and y.(r) are strictly increasing functions of r , these 

points are on the graph of at least one strictly increasing, continuous 

real function. By linearly interpolating between points we selected one 

such function f..(») for each ij . 

According to 'the linear model x^(r) is an estimate of 

uU (C ) - b .l an <i y-( r ) is Q n estimate of u[| (t ) - b.] 

where £ is the 1-1 function of Section III.U. b. is the item 
n 7 i 

difficulty and u(t) = P[l.22t] for P equal to the probability dis- 
tribution of the linear- model. Thus the points < x.(r),y (r) > are 
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estimates of < u[| (C ) - b.],u[| (( ) - b 1 > on the graph of the 
*n *r 1 7 n N *r y 9 * 

function ufu" 1 ^) + b. - b ] . Since the x f s and the y 1 s are 

closely spaced, the graph of f. . will be (pointwise). close to the 
» ij 

graph of the conjugate u[u (•) + b. - b.] , and We are ready to try 

i- o 

the periodic procedure. 

We selected three different functions f^ and solved Abel's 
eqjiation* r for each of them. (Comments on the selection of the f^ 
follbw in this and later sections.) For each k/' we used the same 
solution to^Abel's equation to estimate 



B(ij,k/) = (b. - b 3 )/(b k - bj) 



for all pairs ij of * items in the subtest. 

The results are tabulated in Tables 3a, 5b, 3c and plotted in 
Figures la, lb, lc. Since our programs always estimate B(ii,k/) to 
be zero and B(ji, .K/) to be -B(ij,k/) only" 21 of the possible* h$ 
B(..,k/) need be given.. Only the positive § are tabulated and plotted 
(The trivial estimate B(kjf,k/) = 1 is tabulated but not plotted.) 

The periodic estimates are in the ^second column. The order of the 
rows was determined so that B(ij,k/) (in the third column) increased 

J 

from the first to the last row in each table. The columns labelled E 
and I will be used to illustrate a point considered in a later section. 

The periodic estimates are very close to the LOGIST estimates. To 
make this obvious we computed an overall estimate of b^ from each table 
by averaging B(i«,k/) . That is, for each k/ we computed " 
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Table 5 a 

•Estimates of B(ij;59,77) with Indices 



\ 



i2* t\ 



i 


j 


B 


B 


77 


6 


' .0009 


.013 




51 


.082 


.080 


ill 


77 


.158 




ill 




.12^ 










• u (U 


77 


80 


.305 


.288 


89 


20 


.1)17 


.396 


lit 


80 


.1)05 


.1)31) 


6 


20 


.65^ 


.672 


77 


20 


.709 


.685 


51 


lit 


•739 • 


•775 


111 


20 


.8i)6 


.850 


59 


lit 


.811 


' .851) 


51 


77 


,♦9225 


.920 


51 


C 


.999 


• 933 


59 


77 


1.000 


1.000 


59 


0 


1.000 


1.013 


51 


80 


1.200 


1.209 


59 


80 


1.250 


1.288 


51 


20 


1.552 


1.605 


59 


20 


1.59^ - 


1.685 






4 





\ E 


I 


.870 


.66 


.012 


.16 


.028 


.5»< 


.120 


•15 


.01)5 - 


.058 






.026 ; > ! 


.018 


.055 


1 , 

.Oil) 






.017 


.920 


.021) 


1 .025 


.0095 


.0088 


.026 ' 


.015 


.0011) 


.0025 




.0023 


.000 


.00005 


.0065 


• ' .002? 


/.0057 \ 


.0051 


.015 


\ .001)5 


.017 


\.0055 


.028 


\.0091 
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Table 3b 
Estimates of B(ij;5l,77)' 



. i J 

77 6 

59 51 

Hi .77 

Ik 6 

6 80 

. 77 80 

• 80 20 

iii 80 

6 20 

77 20 

51 Ik 

Ik 20 

59 *U» 

51 77 

51 6 

59 77 

' 59 6 

51 80 

59 80 

51 20 

► 59 20 



• B 

.0214 
.O875 

•159 . 

.158 

.2805 

• 555 

. 145*15 

.700 
.765 
•772 
.917 
•857 
1.000 

1.000 

1.087 
1.001 

1.555 
1.353 
1.727 

1.800 



B' 

.0138 
.08614 
.1585 
.1723 
.299I4 
.3152 
.145Q5 





■ I 


.27 


»72 


.006 


. -17 


.016 


• 56 


• lli 


. .182 


.052 


' .065 - 


.031 » 


.025 


.027 


.026 


.0k2 


.015 


.021 


.02 


•013 


.0077 


>0k3 


.02 


.0081 » 


.OO98 


.0140 


.011 


.006 


.OOOOI4 


?°97 


.00214 


.0005 


.0017 


.0147 


.002Q 


.008 


.0029^ 


.0214 ■ 


.OOU 


.005 


.0017 


.0085 . 


.005 
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Table 3c 
Estimates of B(ij;77,20) 



i 0 




B 


B 


E 


r 77 "6. 




.OOOll • 


.oi9 


' -959 


. * 59 '51 




.167 ■ 


.116 


.18 ' 


^ 77. • 




•3k3 


.213 


.23k 


H ' 6 




.2k0 ' 


■ .232 0 


.017 


6 '80 




. .3335 


-.1403 ' 




77 80 . 




.391 


.k21 


.037 


80 ,20 




.750 


•579 ~* . 


.13 


111 80 




.500 


• .63k 


.12 • 


'6 20 




1.000 


.981 


.0096 


77 20 




1.000 


c 1.000 


.00 


51 Ik 




•857 


1.132 


.1* 


Ik 20 




1.333 


1.213 


.0>i7 


59 Ik ' 




' ' 1.000 


1.2UQ 


.11 


• ... 51 77 




1.356 * 


1.3^5 


.©Oil 


.51 6 ' 




1.211) 


1.363 


.058 


59 T? 




1.500 


l.k6l 


•0l3 V 


59 6 




1.275 


1.1179 




51 80 




1.500 


1.766 


.082 


■- 59 a 80 




1.5685 


1.882 


.091 ' 


51 20 




2.333 


2.3^5 


.0025 


59 20 




2.1l29 


2.I161 


.0065 



J. 



.61 ' 

.26 

•53 , 
.Ik ' 

-.Ol»3. 
•037 . 
.12 

.029 

.022 

.OOOOll 

,028 

.015 

.010'' 

.010 

.0072 

.019- 

.0083 

.039 

.023 

.0013 

.0019 
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Figure la. Periodic and LOGIST estimates of B for k/ = 59>77 
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Figure lb. Periddic and LOGIST estimates of B for k,/ = 51,77 i? 
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Figure lc. Periodic 'and LOGIST estimates of B for k,/ = 77,20, 



Since according to the linear model, the are on an interval scale, 

comparison of the and can be simplified by rescaling the ^ 

so that they have the same mean and variance as the b^ . Our results 
are in Table kP *« - 

Lord (1975) found the standard error of # estimate for item difficulty 
(the square root of the mean squared error of prediction from the 
regression of b^ on b.) to be .196 in a' recent computer simulation 
of the SAT-V. The differences between the Ik and in Table k are 

so small relative tro .I96 that the peribdic estimates and LOGIST 
estimates can be considered interchangeable. 

f We now reconsider the choice of the pair of items k/ . This choice 

is important because if the items are atypical or if f^ make poor use 

of the available data, then fcfr every ij the estimate of B(ij,k/) 

will be adversely affected. A pair of items ,can make poor use of data 

in many ways; For example, if b fc - b^ is very large, then virtually 

all of the data will be used to define a segment of 0 les*s than unit 

length, and the periodic procedure will give poor estimates. If b, - b* 

is nearly zero, then small sampling errors will have large effects on G 

and again the periodic procedure will give poor estimates. 

A straightforward, objective way to reject unacceptable f * 

k/ 

without referring to' b fc - b^ would be to compute periodic estimates 
for all pairs i- < j in the subtest and then test the hypothesis that 
Bfajjk/) is equal to the difference X. - X. between two (unknown, 
estimated) numbers -plus a small random error. An alternative' way is 
introduced in Section VI. % 



Table k 



LOGIST and Periodic Item Difficulty Estimates 







bi,*/ 




k/=59,77 


k/=51,W 


k/=77,20 


.7198 




■ -72^5 _ 


• 731 


.5056 


• 501 


.-U91 c 


•579 


1.6270 


1.6295 


I.6U9 


1.671 




-•555 


' -.56k 


-591 


-.6klQ- 




-.609 • 


-.602 


.7026 


• 700 


.683 


• .678 


1.0919 


1.0835 


1.086 


. .992 
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VI. COMPUTATIONS 

After the main "features of the programs are presented, a particularly 
important part of the computation is discussed in further detail. The 
discussion of this computation will be used^to describe our present 
method for combining observations of examinees on'- different ability 
levels -and obtaining a rough index qf goodness of fit of the equations 
qf the periodic procedure. 

.v. 

VI* 1 Main Features 

We begin by restating the key equations of Section II in a more 
compact and convenient form. 

Suppose 



(VI. 1) 



f(-) = ifhuH + b. - b.] , 

g(-) = u -1 [u(.) + b k - bj] , 



for some increasing, continuous u and positive constants b: - b , 
b, - b/ * • 

Let w be any continuous, strictly increasing solution of Abel's 

** 

equation 

(VI. 2) g(-) = w _3 ;[w(.) '+ 1] 

Define / , -9 by 
(VI. 5) 4 = wfw" 1 , 



(VI.U) 0(x) = $rf(x) - x . 

Then since 0(x) = 0(x + l) and ^(x) = 0(x) + x , fi(x) ; can be computed 
recursively for all n and x from any unit-length segment of the graph 
of 6, . 
W» For each positive integer ,m let m be the smallest integer m* 
such that * ,s , 

(VI.?) ■ yf n (x) < x + m 

for all x . Then 

B = (b. - b.)/(b k - bj) = lim m n /n . 

In fact 

• (VI. 6) 0 < B - m n /n < l/n . 

o 

Instead of (VI. 5) we will use the statistically more stable condition 

/* 

} n 1 

(VI. 5') / A*)dx < £ + m . 
0 

This concludes the summary of Section II. 

Function composition is the basic operation of our programs. MDst. 
of our functions are strictly increasing, continuous, piecewise linear 
mappings of the unit interval onto itself. We encoded each by listing 
the coordinates of 101 points on its graph. The first point is H always 
the oi-igin (0,0), the last always (1,1). 



The first step in the implementation of the periodic procedure 
has already been described. It is the computation of the functions f. 
and f^ that play the role of f and g in (VI • l). 

The second step is solving Abel's equation (VI. 2). The basic 

algorithm was described and illustrated in detail in Levine (1970, Section 

/ 

III. 2 ; also 1975)* That algorithm begins with the choice of a continuous 
function defined on a' short interval in the domain of g and then uses 
Abel f s equation to recursively extend the initial function. 

We experimented with linear initial functions and a function sug- 
gested by an asymptotic result of Krantz. We found that the recursive 
extension of w was generally smoother and easier to encode when the 
initial function was proportional to 



/ dt 

X 0 

where x Q is such that f k ^( x 0 ) has been computed from a large sample 
of candidates and x Q < x < ?^( x q) • The rationale for this formula 
can be found in Krantz (1971; page 593)* 

We recommend choosing items k/ such that f^ has few fixed 
points, since the recursive procedure defines w only between a pair 
of fixed points containing the initial segment (Levine, 1970, Section 
III. 2). We also recommend choosing functions f^ such that it is 
possible to begin the recursive procedure on an interval with statistically 
reliable estimates of function values. We located such intervals by 
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counting the nuiriber of independent observations directly contributing to 

.the estimate of each function value. 

The next step is to compute the functions <f> and 0 . To do this 

we first used the solution to Abel's equation and to define 0 by 

0(x) s= wf w 1 (x) - x . This empirical function is of course not 
i j 

9 

precisely periodic. By approximating it by a periodic fu» uion 9 
we were able to combine information from examinees at different ability 
levels and simultaneously measure the extent to which the data from 
items ijk/ agree with the model. A discussion of 0 is given in the 
next section. Basically 0 is a trigonometric polynomial optimizing 
a measure of periodicity. . 

5 ' - \ 

We also obtained remarkably accurate results, by superimposing 4 
and averagxng cycles of 0 to define an average function S . But 
two problems eventually forced us to abandon S and develop * 0 : • 

(1) For some data the mapping, x S(x) + x is nonmonotonic and 

(2) we failed to find p satisfactory way of averaging to assure 
8(0) = S(l) . ^ 

The empirical function /(x) = 0(x) + x was replaced by /(x) = 
0(x) 4 x where 0 is ths periodic approximation of 0 . 

To estimate* B(ij,k/} we used / n and condition (VI. y) to 
estimate integers m n ? Ouc estimate m n was the smallest integer m 
satisfying 



1 « • ? 

/ f(x) dx < I + m • . 
0 

The estimate of • B was the* minimum of v {m /n : n = 512, 5U, ••• 532} • 

n 

VI . 2 Computation of 9 

The graph of the empirical function -9— commonly, appears smooth and 
approximately periodic over much of the domain of definition of the 
function. However, for very large and very small values of x , the 
graph appears jagged and amorphous.. We experimented with .several ways 
to combine the values of 9(x) to obtain a smooth, periodic function. 
The one presented below does not give the best agreement with IDGIST, 
but it has the advantage of not requiring inspection of intermediate 
results. 

All of the results reported in this paper have been computed by 
first computing a "weight function" Wfr) , which will be seen to control 
the contribution of 9(x) to 9(x) . Note that 9(x) is simply a 
complicated arithmetic expression in the observed proportions s 
and p. a or in the end points f , .(0) « 0 , f, ,(l) « 1 . W(x) 
is zero if an end point is used in the calculation of 9(x) . Otherwise 
W(x)"is the minimum denominator of the observed proportions. Thus 
9(x) is based on at least W(x) independent observations. 

We recommend that W(x) be computed recursively. To do this each 
table defining an f is accompanied by a list of integers (denominators 
or zero). When two functions are composed, the list is updated in the 
obvious way. 



0- is approximated by computing the first few terms of a Fourier 
series. Recall that the Fourier series of a continuous real function h 
with period equal to one is the series H defined by 



H(x) » a + Z [a cos(2jtmx) + b sinfejtmx)] 
o t m * m 

m=l 



where the coefficients, a ,b have the property that for each partial 

m m 

sum H 

n 



H Q (x) = a Q + ■ Z [a^ cos(2jtmx) + b sin(2jtmx)] 
m=l m 



the coefficients minimize the mean squared difference between h $ud 
H 



(VI. 7} / [h(x) - H n (x)] 2 dx . 



To filter irregularities in the graph of 0 we only considered 
partial sums of the form H<- . (We chose five terms after observing that 
the shape of 9 could easily be described with 5 terms and that with 
many terms pathologies like those associated with Gibb's phenomenon 
began to appear. ) 

Instead of minimizing the squared error (VI-7) we selected the 
coefficients of the approximation to minimize the weighted squared. error 
Il || defined by 



*(yi. 8) il© - e*li = ][9(x) - G*(x)] 2 W(x)dx 
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This permits all values of 0(x) to influence the shape of the approxima- 
tion 0 , but only to the extent that they are based on observations. 

Another advantage of (VI. 8) is that it greatly simplifies programming 
and speeds computation. For very high values of x there are no appropriate 
candidates for defining the graph of f • With (VI. 8) we are°free tq 
choose any values^ for the graph that are easy to code and that make the 
compositions well defined* If this is done, the computer is able to 
compute any composition of functions the programmer specif ies> whether 
appropriate data are available or not. However, the portions of graphs 
not based on observations result in zero W and make no contribution to 0 . 
This means that these portions of the graphs are unable to affect the esti- 
mate of B * 

% 

o 

VI. 3 Measuring Periodicity ■ 

As noted in Section IV, the B(ij,k/) can be combined in various 
ways to obtain overall estimates of b^ . To select the best available 
estimates of b^ or B(ij,k/) it would be helpful to be able to examine 
some intermediate results in the computation/of B and determine how well 
B(ij,k/) estimates B(ij,k/) . 

We experimented with various approaches to this problem. Our most 
promising begins with the observation that if the empirical function 9 
cannot be approximated by a periodic function, then there are no ^ 
simultaneously conjugate functions close to f . . and f, / . Thus by 
measuring the periodicity of 0 we may obtain a measure of the error 
in the periodic estimates. 



To measure the periodicity of 9 we first considered 

infinimum {||0~ 9*||- ; 0* is^, a continuous function with 

period equal to one} , 

2 

where || || is the functional F -> J[F(x)] W(x) dx =. ||f|| defined in 
the preceding section. To eliminate effects of scale we divided by ||©j| 
We approximated inf|j9 - 9*|| by ||9 - 9|j . This gives the index of 
periodicity 1(9) = ||9 - 5||/J|0|| = l[©(ij,k/)] . 

To check the conjecture that 1(9) is related ,~%o the error in 
the periodic procedure we compared 1(9) with the measure of error 
E(ij,k/) = |B - B|/|B + B| . A full listing of our results is given 
in Table 5a, 3b, 3c» For fixed k/ the correlations between l(..,k/) 
and E(..,k/) are high ( r = .87, -83, -90 = for (k,/) = (59, 77), 
(51, 77), (77, -0) , respectively). These correlations suggest a 
'simpler relation that is actually present since there is one very large . 
value of E and several very small values of E that are well predicted 



References 

Birnbaum, A. Some latent trait models and their use in inferring an 
examinee's ability. In F. M. *Eo^d and M. R» Novick, Statistical 
theories of mental test scores ^ Reading, Mass.: Addison-Wesley, 
1968. Chapters 17-20. 

Krantz, D. H. Integration of just noticeable differences. Journal of 
Mathematical Psychology, 1971, "8, 591-599^ 

Kruskal, J. B. Nonmetric multidimensional scaling: a numerical method. 

X 

Psychometrika, 196U, 2g, 115-129. 
Levine, M. V. Transformations that render curves parallel'. Journal of 

Mathematical Psychology, 1970, 'l> ^10-^33 • 
Levine, M. V. Transforming 'curves to curves with the same shape. 

Journal of Mathematical Psychology, 1972, hlO-kty. 

</ t : /, " \ * 

Levine, M. V. Additive measurement with short segments of curveg. 

Journal of Mathematical Psychology, 1975, 12, 212-224. y ^ 

s 

'* ,t 

Levine, M. V. Nonadditive analogues of the basic mathematics of additive 
measurement. Submitted to Journal of Miathematical Psychology, 197^» 
Lord, F. M. An analysis* of the Verbal Scholastic Aptitude Test using 
c birnbaum 1 s three-parameter logistic model. " Educational and 
Psychological Measurement, 1968/28, 989-IO2O. * 
Lord, Kr„M* Item^aracteristic curves as estimated without knowledge 
v 1 of' their mathematical forrn--a confrontation qf Birnbaum' s logistic 
'> model. Psychometrika, 1^70, ^3-50. 



lorji, P. M." Evaluation with 'artificial data of a procedure for 
^estimating ability and item characteristic curve parameters. 
Research Bulletin 75-3;'. Princeton, N.J. : Educational Testing 
Service, 1975* 

Lord, F. M. and Novick, M. R. Statistical theories of mental test 
scores . o Reading, Mass. : Addison-Wesley, *1968. 

Rasch, G. Probabilistic models for some intelligence and attainment 
tests . Copenhagen: Nielson and Lydicke, i960. 



